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REMINDER: 

you may find yourself wondering what 
this has to do with JavaScript... 
all of what follows has been 
implemented in JavaScript 



REMINDER: 
you may find yourself wondering what 
this has to do with JavaScript... 
all of what follows has been 
implemented in JavaScript 
these are tools YOU can use tomorrow 



let's build an app 



a few features later... 



that's not distribution 



but I will never... 



ok, but let's not stop just yet 



can we go farther? 



can we build systems that 
build themselves? 



why? 



WTTyT 



why not? 



well... what about control? 




do you think that's air you'riTHreathing? 



invariants 



but... distributed 

is hard 



computing 



the network is reliable 

latency isn't a problem 

bandwidth isn't a problem 

the network is secure 

topology won't change 

the administrator will know what to do 

transport cost isn't a problem 

the network is homogeneous 

the system is atomic/monolithic 

the system is finished 

business logic can and should be centralized 




unfamiliar ^ hard 



what about 
premature optimization? 



what about cost? 



it's about 
composability 



it's about scale-free 

composability 



overwhelmed 



effort ± impact 



we can simplify 



look for decentralized patterns 



a distributed toolkit approach 



a distributed 



discovery 
pulling data 
pushing data 
failure detection 



storing data 
data reconciliation 
load balancing 



discovery 



discovery 



discovery 



Distributed Hasl 



Tables (DHTs) 



discovery - DHTs 



discovery - DHTs 



there are many implementations 



discovery - DHTs 



Kademlia DHT 



discovery - DHTs 



Kademlia DHT 
(for discovery) 



discovery - DHTs 



protocol + bucket storage 



discovery - DHTs - bucket storage 



discovery - DHTs 



bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 000011H 



discovery - DHTs 



bucket storage 



00001016 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 000011H 



discovery - DHTs 



bucket storage 



00001010 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
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00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
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00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
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bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
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bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
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bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
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bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
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bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
00001010 
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bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 000011H 
00001010 



discovery - DHTs 



bucket storage 



00001106 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 000011H 
00001010 



discovery - DHTs 



bucket storage 



00001100 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
00001010 
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00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
00001010 
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00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
00001010 
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00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
00001010 
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00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 
00001010 



discovery - DHTs 



bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 



00001010 



discovery - DHTs 



bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 



00001010 



discovery - DHTs - bucket 



0 



11010100 
10101101 
11010101 

11001010 ©1000000 



0 



01100101 

01001101 eexeeiee 
01001110 001100H 

00100100 
00100111 



0 



00010101 
00010001 
00010100 



storage 



node 00000000 
k = 4 



00001100 
0 



00000101 
00000001 

00001111 ^ — FULL 

00001010 



discovery - DHTs 



bucket storage 




00100100 00010101 00000101 
00100111 00010001 00000001 
00010100 00001111 



00001010 



discovery - DHTs 



bucket storage 




00010100 00000101 

00000001 
00001111 
00001010 



discovery - DHTs - bucket 



0 



11010100 
10101101 
11010101 

11001010 ©1000000 



0 



01100101 

01001101 eexeeiee 
01001110 001100H 

00100100 
00100111 



0 



00010101 
00010001 
00010100 



storage 



node 00000000 
k = 4 



00001100 
0 



0 



00001111 00000101 

00001010 00000001 



discovery - DHTs - bucket 



0 



11010100 
10101101 
11010101 

11001010 ©1000000 



0 



01100101 

01001101 eexeeiee 
01001110 001100H 

00100100 
00100111 



0 



00010101 
00010001 
00010100 



storage 



node 00000000 
k = 4 



00001100 
0 



0 



00001111 00000101 

00001010 00000001 



discovery - DHTs - bucket 



0 



11010100 
10101101 
11010101 

11001010 ©1000000 



0 



01100101 

01001101 eexeeiee 
01001110 001100H 

00100100 
00100111 



0 



00010101 
00010001 
00010100 



storage 



node 00000000 
k = 4 



0 



00001111 
00001010 
00001100 



00000101 
00000001 



discovery - DHTs - bucket 



11010100 ^ 

10101101 cr 
11010101 

11001010 01000000 
01100101 



01001101 eeieeiee 
01001110 001100H 
00100100 
001001H 



00010101 

00010001 
00010100 



storage 



node 00000000 
k = 4 



0 



00001111 
00001010 
00001100 



00000101 

00000001 



discovery - DHTs - bucket storage 



11001110 



11010100 
10101101 
11010101 

11001010 0100000® 
01100101 

01001101 eeieeiee 
01001110 001100H 
00100100 
001001H 



00010101 
00010001 

00010100 



node 00000000 
k = 4 




00001111 
00001010 
00001100 



00000101 
00000001 



discovery - DHTs - bucket storage 



11001110 



11010100 

10101101 
11010101 

11001010 01000000 

01100101 

01001101 eexeeiee 
01001110 001100H 

00100100 
00100111 



00010101 
00010001 
00010100 



node 00000000 
k = 4 




00001111 
00001010 
00001100 



00000101 
00000001 



discovery - DHTs - bucket storage 



11001110 



FULL 



11010100 
10101101 
11010101 

11001010 01000000 

01100101 

01001101 eexeeiee 
01001110 001100H 

00100100 
00100111 



00010101 
00010001 
00010100 



node 00000000 
k = 4 




00001111 
00001010 
00001100 



00000101 
00000001 



discovery - DHTs - bucket storage 



11001110 



DON'T SPLIT 



11010100 
10101101 
11010101 

11001010 01000000 

01100101 



01001101 eexeeiee 
01001110 001100H 

00100100 00010101 

00100111 00010001 
00010100 



node 00000000 
k = 4 




00001111 
00001010 
00001100 



00000101 
00000001 
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11001110 



PING NODES 



11010100 
10101101 
11010101 

11001010 01000000 

01100101 



01001101 eexeeiee 
01001110 001100H 

00100100 00010101 

00100111 00010001 
00010100 



node 00000000 
k = 4 




00001111 
00001010 
00001100 



00000101 
00000001 



discovery - DHTs - bucket storage 



11001110 



11010100 
10101101 
11010101 

11001010 0100000® 

01100101 

REPLACE 01001101 00^00 

NON- RESPONSIVE 01001110 00116011 

NODE 00100100 

00100111 



00010101 
00010001 
00010100 



node 00000000 
k = 4 




00001111 
00001010 
00001100 



00000101 
00000001 



discovery - DHTs - bucket storage 



0 



node 00000000 
k = 4 



REPLACE 
NON- RESPONSIVE 
NODE 



11010100 
11001110 
11010101 

11001010 01000000 

01100101 
01001101 
01001110 



0 



00100100 
00110011 
00100100 
00100111 



0 



00010101 
00010001 
00010100 



00001111 
00001010 
00001100 



0 

00000101 
00000001 



discovery - DHTs - bucket 



0 



11010100 
11001110 
11010101 

11001010 ©1000000 



0 



01100101 

01001101 eexeeiee 
01001110 001100H 

00100100 
00100111 



0 



00010101 
00010001 
00010100 



storage 



node 00000000 
k = 4 



0 



00001111 
00001010 
00001100 



00000101 

00000001 



discovery - DHTs - bucket 



11010100 ^ 

11001110 cr 
11010101 

11001010 01000000 
01100101 



01001101 eeieeiee 
01001110 001100H 
00100100 
001001H 



00010101 

00010001 
00010100 



storage 



node 00000000 
k = 4 



0 



00001111 
00001010 
00001100 



00000101 

00000001 
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"typical" config: 
k = 20 



discovery - DHTs - bucket storage 



each node stores info on 20 * Ig (n) 

nodes 



discovery - DHTs - bucket storage 



"lg"s are awesome: 
20 * lg( 1,000,000,000) = ~ 598 

20 * lg(l,000,000,000,000) = ~ 798 
20 * lg(l,000,000,000,000,000) = ~ 997 



discovery - DHTs - protocol 



discovery - DHTs - protocol 



FIND NODE and PING 



discovery - DHTs - protocol 

/ \ 

s-i 



f \ 

S-2 



discovery - DHTs - protocol 



/ \ 

N 



discovery - DHTs - protocol 




discovery - DHTs - protocol 




discovery - DHTs - protocol 



discovery - DHTs - protocol 




discovery - DHTs - protocol 




discovery - DHTs - protocol 



discovery - DHTs - protocol 




discovery - DHTs - 





t « 

S-2 



discovery - DHTs - protocol 




discovery - DHTs - protocol 




(returns closest) 



discovery - DHTs - protocol 
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discovery - DHTs - protocol 




discovery - DHTs - protocol 




N-ll 




discovery - DHTs - protocol 
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discovery - DHTs - protocol 




discovery - DHTs 

| N-44 j 







N-3 



discovery - DHTs 
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N-3 



discovery - DHTs 

| N-44 j 







N-3 



discovery - DHTs - prol 



we can now 



find things 



pulling data 



pulling data 



pulling data 



DHTs 



pulling data - DHTs 



pulling data - DHTs 




0 ,q 




| s-0 I 



N 








[ N-9 j 




pulling dat a - DH Ts 



20af . . . 
3547. . . 
ce04. . . 
0d05. . . 



8baf . 
a31c. 
923b. 



d94a. . . 
e475. . . 
ccdf . . . 
9d41. . . 



N 



7fb9. . . 
7548. . . 
3771. . . 
a929. . . 



65a6. . . 
d912. . . 
a76f . . . 
e82d. . . 



b0a9. . . 
accc . . . 
leff . . . 
b77a . . . 



5335. . . 
2d68. . . 
9ac4. . . 



ce34. . . 
fa40. . . 
0e8b. . . 
beeb. . . 



04db. . . 
20ac. . . 
339e. . . 
5d8e. . . 



3b7c . . . 
cd55. . . 
9f 46 . . . 



c947 
15a9 
d688 
4d9f 




09bf . . . 
abf2. . . 
8d38. . . 
I cf01. . . 



pulling dat a - DH Ts - add BitTorrent 



20af . . . 
3547. . . 
ce04. . . 
0d05. . . 



8baf . 
a31c. 
923b. 



d94a. . . 
e475. . . 
ccdf . . . 
9d41. . . 



N 



f 


7fb9. . . 




c 


b0a9. . . 






7548. . . 






accc . . . 






3771. . . 






leff . . . 






a929. . . 






b77a. . . 


J 



65a6. . . 
d912. . . 
a76f . . . 
e82d. . . 



5335. . . 
2d68. . . 
9ac4. . . 



ce34. . . 
fa40. . . 
0e8b. . . 
beeb. . . 



04db. . . 
20ac. . . 
339e. . . 
5d8e. . . 



3b7c . . . 
cd55. . . 
9f 46 . . . 



c947 
15a9 
d688 
4d9f 




09bf . . . 
abf2. . . 
8d38. . . 
I cf01. . . 
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direct connections 
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pulling data - direct connections 

1 — j f — i 





N 








[ N-9 j 




pulling data - direct connections 

1 — j f — i 








[ N-9 j 






pulling data - direct connections 



use merkle-trees 
to get only what you need 
(more later) 



pulling data - direct connections 



we can now retrieve data 



pushing data 



pushing data 



pushing data 



gossip 



pushing data - gossip 



pushing data - gossip 



every connected node is 
informed of the state 
of every other connected node 



pushing data - gossip 



scuttlebutt reconciliation 



pushing data - gossip 



scuttlebutt reconciliation 
(there are others) 



pushing data - gossip 



pushing data - gossip 



/ 1 

G-0 
I J 



pushing data - gossip 




pushing data - gossip 




pushing data - gossip 



G-0 



S-0 



vc = 17 



S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ K B M ,27] 


S-2@22 


: f oo = 


[ ff K M ,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K".,22] 



S-0@17 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M ,27] 


S-2@22 


: f oo = 


[ K K M ,22] 



pushing data - gossip 



G-0 



vc = 0 



S-0 



vc = 17 



S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 



ED 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K".,22] 



S-0@17 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M ,27] 


S-2@22 


: f oo = 


[ K K M ,22] 
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S-0 



vc = 17 



S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 



ED 





S-2 


vc = 22 


= 27 






S-9@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



S-0@17 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M ,27] 


S-2@22 


: f oo = 


[ K K M ,22] 



pushing data 



gossip 




S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 





S-2 


vc = 22 


= 27 






S-9@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



S-0@17 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M ,27] 


S-2@22 


: f oo = 


[ K K M ,22] 
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s-e@e 

S-1@0 




S-2@0 



S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 



S- 0(317 : foo 
S-l@27 : foo 
S-2@22 : foo 





S-2 


vc = 22 


= 27 






S-0@17 : 


foo = 


["A" .,17] 


S-l@27 : 


foo = 


[ ff B M ,27] 


S-2@22 : 


foo = 


["K w ,22] 



["A" .,17] 
[ f 'B M ,27] 
[ ff K M ,22] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



vc = 27 



S-0@17 
S-l@27 
S-2@22 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M J 27] 
S-2@22 : foo = [ rf K M ,22] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 




vc = 22 



vc = 27 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 
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s-e@e 

S-1@0 




S-2@0 



S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 



G-0@0 : 

S-0@17 : foo 

S-l@27 : foo 

S-2@22 : foo 





S-2 


vc = 22 


= 27 






S-0@17 : 


foo = 


["A" .,17] 


S-l@27 : 


foo = 


[ ff B M ,27] 


S-2@22 : 


foo = 


["K w ,22] 



["A" .,17] 
[ ff B M ,27] 
["K».,22] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 




vc = 22 



vc = 27 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 




vc = 22 



vc = 27 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



G- 

S -0(317 
S-l@27 
S-2@22 



vc = 27 



foo 
foo 
foo 



["A", 17] 
[ rf B M J 27] 
[ rf K M ,22] 




vc = 22 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



[S-0,f oo, M A M ,17] 



pushing data 



gossip 



G-0@0 S- 

s-i@e s-2@e 




S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 



G- 0(5)0 






S-0@17 


f 00 = 


["A", 17] 


S-l@27 


f 00 = 


[ ff B M ,27] 


S-2@22 


f 00 = 


["K M .,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



[S-0,foo,"A",17] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



G- 
S-0@17 
S-l@27 
S-2@22 



vc = 27 



foo 
foo 
foo 



["A", 17] 
[ rf B M J 27] 
[ rf K M ,22] 




vc = 22 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



[S-0,foo,"A",17] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



G- 
S-0@17 
S-l@27 
S-2@22 



vc = 27 



foo 
foo 
foo 



['^17] 
[ rf B M J 27] 
[ rf K M ,22] 




vc = 22 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



[S-0,foo,"A",17] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



G- 
S-0@17 
S-l@27 
S-2@22 



vc = 27 



foo 
foo 
foo 



['^17] 
[ rf B M J 27] 
[ rf K M ,22] 




vc = 22 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



[S-9,foo,"A",17] 
[S-l,foo, M B M ,27] 



pushing data 



gossip 



G-0@0 S- 

s-i@e s-2@e 




S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 



G- 0(5)0 






S-0@17 


f 00 = 


["A", 17] 


S-l@27 


f 00 = 


[ ff B M ,27] 


S-2@22 


f 00 = 


["K M .,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



[S-0,foo,"A",17] 
[S-l,foo, M B M ,27] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



G- 
S-0@17 
S-l@27 
S-2@22 



vc = 27 



foo 
foo 
foo 



["A", 17] 
[ rf B M J 27] 
[ rf K M ,22] 




vc = 22 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



[S-9,foo,"A",17] 
[S-l J foo/ , B M J 27] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



vc = 27 



G- 0(5)0 






S-0@17 


foo = 


["A'%17] 


S-l@27 


foo = 


[ t( B",27] 


S-2@22 


foo = 


["K'%22] 




vc = 22 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



[S-9,foo,"A",17] 
[S-l J foo/ , B M J 27] 



pushing data 



gossip 



G-0@0 S-0@0 
S-1@0 S-2@0 




S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



vc = 27 



G- 0(5)0 






S-0@17 


foo = 


["A'%17] 


S-l@27 


foo = 


[ t( B",27] 


S-2@22 


foo = 


["K'%22] 




vc = 22 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



[S-9,foo,"A",17] 
[S-l,foo,"B",27] 
[S-2,foo/'K w ,22] 



pushing data 



gossip 



G-0@0 S- 

s-i@e s-2@e 




S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 



G- 0(5)0 






S-0@17 


f 00 = 


["A", 17] 


S-l@27 


f 00 = 


[ ff B M ,27] 


S-2@22 


f 00 = 


["K M .,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



[S-0,foo,"A",17] 
[S-l,foo/'B M ,27] 
[S-2 J foo/ , K M J 22] 



pushing data - gossip 




S-0 



vc = 17 



S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 



ED 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



G- 0(5)0 






[S-0jfoOj 


"A", 17] 


S-0@17 


f 00 = 


["A", 17] 


[S-ljfoOj 


M B",27] 


S-l@27 


f 00 = 


[ ff B M ,27] 


[S-2jfoOj 


M K",22] 


S-2@22 


f 00 = 


["K M .,22] 







pushing data - gossip 




S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



G- 0(5)0 






S-0@17 


f 00 = 


["A", 17] 


S-l@27 


f 00 = 


[ ff B M ,27] 


S-2@22 


f 00 = 


["K M .,22] 



[S-0,foo,"A",17] 
[S-l,foo/'B M ,27] 
[S-2 J foo/ , K M J 22] 



pushing data - gossip 



[S-0,foo, M A M ,17] 
[S-l,foo, M B M ,27] 
[S-2,foo, M K M ,22] 




vc = 



S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



G- 0(5)0 






S-0@17 


f 00 = 


["A", 17] 


S-l@27 


f 00 = 


[ ff B M ,27] 


S-2@22 


f 00 = 


["K M .,22] 



pushing data - gossip 



[S-9,foo,"A",17] 
[S-l,foo,"B",27] 
[S-2,foo/'K",22] 




S-0@17 : foo = ["A" , 17] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



vc = 27 



S-0@17 
S-l@27 
S-2@22 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 



[S-9,foo,"A",17] 
[S-l,foo,"B",27] 
[S-2,foo/'K",22] 




vc = 27 



S-0@17 
S-l@27 
S-2@22 



foo 
foo 
foo 



["A", 17] 
["B'%27] 
[ t( K",22] 



S-0@17 
S-l@27 
S-2@22 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 



G-0 



[S-9,foo,"A",17] 
[S-l,foo,"B",27] 
[S-2,foo/'K",22] 



vc = 0 



S-0@17: foo = ["A" .,17] 
S-1@0 : 
S-2@0 : 



S-0 



vc = 17 



S-l 



vc = 27 



S-0@17 
S-l@27 
S-2@22 



foo 
foo 
foo 



["A'%17] 
["B'%27] 
[ t( K",22] 



S-0@17 
S-l@27 
S-2@22 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 



[S-0,foo, M A M ,17] 
[S-l,foo, M B M ,27] 
[S-2,foo, M K M ,22] 



S-0@17: 
S-1@0 : 
S-2@0 : 




f oo = 



S- 0(317 


: f oo = 


["A" .,17] 


S-l@27 


: f oo = 


[ ff B M J 27] 


S-2@22 


: f oo = 


[ ff K M ,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


f 00 = 


["A" .,17] 


S-l@27 : 


f 00 = 


[ ff B M ,27] 


S-2@22 : 


f 00 = 


["K w ,22] 



G- 0(5)0 






S-0@17 


f 00 = 


["A", 17] 


S-l@27 


f 00 = 


[ ff B M ,27] 


S-2@22 


f 00 = 


["K M .,22] 



pushing data - gossip 



G-0 



[S-Q,f00/'A",17] 
[S-l,foo,"B",27] 
[S-2,foo/'K",22] 



vc = 0 



S-0@17: foo = ["A" ,17] 
S-1@0 : 
S-2@0 : 



S-0 



vc = 17 



S-l 



vc = 27 



S-0@17 
S-l@27 
S-2@22 



foo 
foo 
foo 



["A'%17] 
["B'%27] 
[ t( K",22] 



S-0@17 
S-l@27 
S-2@22 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 



G-0 



vc = 0 



S-0@17: foo = [^",17] 
S-1@0 : foo = ["B'%27] 
S-2@0 : 



S-0@17 
S-l@27 
S-2@22 



[S-9,foo,"A",17] 
[S-l,foo,"B",27] 
[S-2 J foo/ , K M J 22] 



S-0 



vc = 17 



S-l 



vc = 27 



foo 
foo 
foo 



["A'%17] 
["B'%27] 
[ t( K",22] 



S-0@17 
S-l@27 
S-2@22 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 



G-0 



vc = 0 



S-0@17: foo = [^",17] 
S-l@27: foo = ["B'%27] 
S-2@0 : 



S-0@17 
S-l@27 
S-2@22 



[S-9,foo,"A",17] 
[S-l,foo,"B",27] 
[S-2 J foo/ , K M J 22] 



S-0 



vc = 17 



S-l 



vc = 27 



foo 
foo 
foo 



["A'%17] 
["B'%27] 
[ t( K",22] 



S-0@17 
S-l@27 
S-2@22 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 




[S-0,foo, M A M ,17] 
[S-l,foo, M B M ,27] 
[S-2,foo, M K M ,22] 



S-0@17: 
S-l@27: 
S-2@0 : 



foo 
foo 




["A" .,17] 
[ ff B M ,27] 



S- 0(317 


: foo = 


["A" .,17] 


S-l@27 


: foo = 


[ ff B M J 27] 


S-2@22 


: foo = 


[ ff K M ,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


foo = 


["A" .,17] 


S-l@27 : 


foo = 


[ ff B M ,27] 


S-2@22 : 


foo = 


["K w ,22] 



G- 0(5)0 






S-0@17 


foo = 


["A", 17] 


S-l@27 


foo = 


[ ff B M ,27] 


S-2@22 


foo = 


["K M .,22] 



pushing data - gossip 



G-0 



vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ f 'B M ,27] 
S-2@0 : 



S-0@17 
S-l@27 
S-2@22 



[S-9,foo,"A",17] 
[S-l,foo,"B",27] 
[S-2,foo, M K",22] 



S-0 



vc = 17 



S-l 



vc = 27 



foo 
foo 
foo 



["A'%17] 
["B'%27] 
[ t( K",22] 



S-0@17 
S-l@27 
S-2@22 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 

[S-9,foo,"A",17] 




S-2@0 : foo = [ ff K M ,22] 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ W B",27] 
S-2@22 : foo = ["K w ,22] 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 

[S-9,foo,"A",17] 




S-2@22: foo = ["K'%22] 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ W B",27] 
S-2@22 : foo = ["K w ,22] 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = [ ff B M ,27] 
S-2@22 : foo = [ rf K M ,22] 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 




[S-0,foo, M A M ,17] 
[S-l,foo, M B M ,27] 
[S-2,foo, M K M ,22] 



S- 0(317: foo 
S-l@27: foo 
S-2@22: foo 




["A" .,17] 
[ ff B M ,27] 
[ ff K M ,22] 



S- 0(317 


: foo = 


["A" .,17] 


S-l@27 


: foo = 


[ ff B M J 27] 


S-2@22 


: foo = 


[ ff K M ,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


foo = 


["A" .,17] 


S-l@27 : 


foo = 


[ ff B M ,27] 


S-2@22 : 


foo = 


["K w ,22] 



G- 0(5)0 






S-0@17 


foo = 


["A", 17] 


S-l@27 


foo = 


[ ff B M ,27] 


S-2@22 


foo = 


["K M .,22] 



pushing data - gossip 




vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ Cf B M J 27] 
S-2@22: foo = ["K'%22] 




vc = 17 



S- 0(317 


: foo = 


["A" .,17] 


S-l@27 


: foo = 


[ ff B M J 27] 


S-2@22 


: foo = 


[ ff K M ,22] 



ED 





S-2 


vc = 22 


= 27 






S-0@17 : 


foo = 


["A" .,17] 


S-l@27 : 


foo = 


[ ff B M ,27] 


S-2@22 : 


foo = 


["K w ,22] 



G- 0(5)0 






S-0@17 


foo = 


["A", 17] 


S-l@27 


foo = 


[ ff B M ,27] 


S-2@22 


foo = 


["K M .,22] 



pushing data - gossip 




vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ ff B M ,27] 
S-2@22: foo = ["K'%22] 




vc = 17 



S-0@17 : foo = ["A" ,17] 
S-l@27 : foo = ["B'%27] 
S-2@22 : foo = ["K w ,22] 





vc = 22 



vc = 27 



S-0@17 
S-l@27 
S-2@22 



foo 
foo 
foo 



["A M ,17] 
[ ff B M ,27] 
[ rf K M ,22] 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 




vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ ff B M ,27] 
S-2@22: foo = ["K'%22] 




vc = 17 



S-0@17 : foo = ["Q'%18] 
S-l@27 : foo = [ W B",27] 
S-2@22 : foo = ["K w ,22] 





vc = 22 



vc = 27 



S-0@17 
S-l@27 
S-2@22 



foo 
foo 
foo 



["A M ,17] 
[ ff B M ,27] 
[ rf K M ,22] 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 




vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ ff B M ,27] 
S-2@22: foo = ["K'%22] 




vc = 18 



S-0@18 : foo = ["Q'%18] 
S-l@27 : foo = [ W B",27] 
S-2@22 : foo = ["K w ,22] 





vc = 22 



vc = 27 



S-0@17 
S-l@27 
S-2@22 



foo 
foo 
foo 



["A M ,17] 
[ ff B M ,27] 
[ rf K M ,22] 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 




vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ Cf B M J 27] 
S-2@22: foo = ["K'%22] 




vc = 18 



S-0@18 


: foo = 


["QMS] 


S-l@27 


: foo = 


[ ff B M ,27] 


S-2@22 


: foo = 


[ ff K M ,22] 



ED 





S-2 


vc = 22 


= 27 






S-0@17 : 


foo = 


["A" .,17] 


S-l@27 : 


foo = 


[ ff B M ,27] 


S-2@22 : 


foo = 


["K w ,22] 



G- 0(5)0 






S-0@17 


foo = 


["A", 17] 


S-l@27 


foo = 


[ ff B M ,27] 


S-2@22 


foo = 


["K M .,22] 



pushing data - gossip 




vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ Cf B M J 27] 
S-2@22: foo = ["K'%22] 




S-0@18 


: foo = 


["QMS] 


S-l@27 


: foo = 


[ ff B M ,27] 


S-2@22 


: foo = 


[ ff K M ,22] 





S-2 


vc = 22 


= 27 






S-0@17 : 


foo = 


["A" .,17] 


S-l@27 : 


foo = 


[ ff B M ,27] 


S-2@22 : 


foo = 


["K w ,22] 



G- 0(5)0 






S-0@17 


foo = 


["A", 17] 


S-l@27 


foo = 


[ ff B M ,27] 


S-2@22 


foo = 


["K M .,22] 



pushing data 




S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ ff B M ,27] 
S-2@22: foo = ["1^22] 



S-0@18 
S-l@27 
S-2@22 



gossip 



foo 
foo 
foo 



["QMS] 
[ ff B M ,27] 
[ ff K M ,22] 



G-0@0 
S-l@27 



■0(317 






S-2 


vc = 22 


= 27 






S-0@17 : 


foo = 


["A" .,17] 


S-l@27 : 


foo = 


[ ff B M ,27] 


S-2@22 : 


foo = 


["K w ,22] 



G- 0(5)0 






S-0@17 


foo = 


["A", 17] 


S-l@27 


foo = 


[ ff B M ,27] 


S-2@22 


foo = 


["K M .,22] 



pushing data - gossip 




vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ ff B M ,27] 
S-2@22: foo = ["K'%22] 



S-0@18 : foo = ['^",18] 
S-l@27 : foo = [ rf B M J 27] 
S-2@22 : foo = ["K w ,22] 



G-0@0 S- 0(317 
S-l@27 S-2@22 




vc = 27 



S-0@17 
S-l@27 
S-2@22 



G-0@0 : 

S-0@17 : foo = ["A", 17] 

S-l@27 : foo = [ rf B M J 27] 

S-2@22 : foo = ["K",22] 



pushing data - gossip 




vc = 0 



S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ ff B M ,27] 
S-2@22: foo = ["K'%22] 



G-0@0 
S-0@18 
S-l@27 
S-2@22 



foo 
foo 
foo 



[ K Q'M8] 
[ rf B M ,27] 
["K",22] 



G-0@0 
S-l@27 




•0@17 
■2(5)22 



G- 
S-0@17 
S-l@27 
S-2@22 



vc = 27 



S-0@17 
S-l@27 
S-2@22 



foo 
foo 
foo 



["A", 17] 
[ rf B M J 27] 
[ rf K M ,22] 



pushing data 




S-0@17: foo = ["A" .,17] 
S-l@27: foo = [ ff B M ,27] 
S-2@22: foo = ["1^22] 



G-0@0 
S-0@18 
S-l@27 
S-2@22 
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var exp = -1 * currentlnterval / self.intervalsMean; 

var p = Math.pow(Math.E, exp); 

return -1 * (Math.log(p) / Math.log(lO)); 
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distributed estimation of "liveness" 
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what about scale-free 
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based on density and "liveness" 
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WebRTC 

we can find things 
we can retrieve data 
we can have global state 
we can detect failures 
we can store data without losing it 
we can coordinate our data 
we can load balance 



WebRTC 

REMINDER: 
you may find yourself wondering what 
this has to do with JavaScript... 
all of what follows has been 
implemented in JavaScript 
these are tools YOU can use tomorrow 



WebRTC 



The future is already here... 
it's just not very evenly distributed. 



— William Gibson 
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